This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 



BEST AVAILABLE IMAGES 

Defective images within this document are accurate representation of 
The original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 

IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



Searching PAJ 



1/2 /<— i/ 



PATENT ABSTRACTS OF JAPAN 

(1 1 )Publication number : 08-339288 
(43)Date of publication of application : 24.12.1996 



(SDlntCL 3/16 

G06F 3/14 
G06F 3/14 
G06F 17/30 
61 OL 3/00 
G10L 5/02 



(21) Application number : 07^147291 (71)Applicant : CANON INC 

(22) Date of filing : 14.06.1 995 (72)Inventor : SAKAI KEDCHI 

YAGISAWA TSUYOSHI 
FUJITA MINORU 



it02 


in - 
























MP'' 











7^. 



(54) INFORMATION PROCESSOR AND CONTROL METHOD THEREFOR 
(57)Abstract: 

PURPOSE: To change the form of a response sentence 
and the synthesized voice for each task and to make a 
user recognize that the task is changed in a voice 
interactive processing. 

CONSTITUTION: In this information processor (voice 
interactive device) provided with the plural executable 
tasks, different agents are allocated corresponding to 
the respective plural tasks and stored in an agent 
attribute holding part 108. In the meantime, an input 
sentence recognized in a voice recognition part 1 02 is 
analyzed in an input sentence analysis part 103. A task 
judgment part 104 decides the task to be used based on 
the analyzed result and generates a command adapted 
to the execution task based on the input sentence. A 
sentence generation part 109 generates the response 
sentence based on a executed result obtained by 
executing the command by the execution task. The 
response sentence is formed corresponding to the 
attribute information of the agent corresponding to the 

execution task and a voice synthesis part 1 1 0 voice- synthesizes the response sentence 
corresponding to the attribute information. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer.So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The information processor which has two or more tasks which are characterized by 
providing the following, and which can be performed. A storing means to store different creation 
information corresponding to each of two or more aforementioned tasks. A determination means 
to detemnine the execution task which should analyze an input statement and should be used 
out of two or more aforementioned tasks. Real way stage which generates the command which is 
adapted for the execution task determined with the aforementioned determination means based 
on the aforementioned input statement, executes this command by this execution task, and 
obtains an execution result. A generation means to generate a response sentence based on the 
creation information corresponding to the aforementioned execution task stored in the 
aforementioned storing means, and the execution result obtained with the aforementioned 
execution means, and an output means to output the response sentence generated with the 
aforementioned generation means. 

[Claim 2] The aforementioned creation information is an information processor according to 
claim 1 characterized by specifying the style of the response sentence generated with the 
aforementioned generation means. 

[Claim 3] The aforementioned creation information is an information processor according to 
claim 1 characterized by specifying the foreground color of the response sentence generated 
with the aforementioned generation means. 

[Claim 4] The aforementioned output means is an information processor according to claim 1 
characterized by synthesizing voice based on the aforementioned response sentence, and 
performing a voice output. 

[Claim 5] The information processor which has two or more tasks which are characterized by 
providing the following, and which can be performed. A storing means to store different creation . 
information corresponding to each of two or more aforementioned tasks, A determination means 
to determine the execution task which should analyze an input statement and should be used 
out of two or more aforementioned tasks. Real way stage which generates the command which is 
adapted for the execution task determined with the aforementioned determination means based 
on the aforementioned input statement, executes this command by this execution task, and 
obtains an execution result. A synthetic means synthesize voice based on a generation means 
generate a response sentence based on the creation information corresponding to the 
aforementioned execution task stored in the aforementioned storing means, and the execution 
result obtained with the aforementioned execution means, and the creation information 
corresponding to the aforenrentioned execution task stored in the aforementioned storing means 
and the response sentence which were generated with the aforementioned generation means. 
[Claim 6] The information processor according to claim 5 characterized by having further an 
input-statement generation means to generate an input statement based on the inputted sound 
signal. 

[Claim 7] The aforementioned creation information is an information processor according to 
claim 5 characterized by including the information which specifies the style of the response 
s ntenc generated with the aforementioned generation m ans. 
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[Claim 8] The information processor according to claim 5 characterized by having further a 
display means to display the aforementioned respons sentence. 

[Claim 9] The aforementioned creation infonnation is an information processor according to 
claim 8 characterized by specifying the foreground color by the aforementioned display means of 
the response sentence generated with the aforementioned gen ration means. 
[Claim 1 0] The aforementioned creation information is an information processor according to 
claim 5 characterized by including each parameter of the speech synthesis processing in the 
aforementioned synthetic means. Formula. 

[Claim 1 1] The control method of an information processor characterized by providing the 
following of having two or more tasks which can be performed. The storing process which stores 
different creation information corresponding to each of two or more aforementioned tasks. The 
determination process which determines the execution task which should analyze an input 
statement and should be used out of two or more aforementioned tasks. The execution process 
which generates the command which is adapted for the execution task determined at the 
aforementioned determination process based on the aforementioned input statement, executes 
this command by this execution task, and obtains an execution result The generation prbcess 
which generates a response sentence based on the creation information corresponding to the 
aforementioned execution task stored at the aforementioned storing process, and the execution 
result obtained at the aforementioned execution process, and the output process which outputs 
the response sentence generated at the aforementioned generation process. 
[Claim 1 2] The control method of an information processor characterized by providing the 
following of having two or more tasks which can be performed. The storing process which stores 
different creation information corresponding to each of two or more aforementioned tasks. The 
- determination process which determines the execution task which should analyze an input 
statement and should be used out of two or more aforementioned tasks. The execution process 
which generates the command which is adapted for the execution task determined at the 
« ' aforementioned determination process based on the aforementioned input statement, executes 
this command by this execution task, and obtains an execution result. The synthetic process 
which synthesizes voice based on the generation process which generates a response sentence 
based on the creation information corresponding to the aforementioned execution task stored at 
the aforementioned storing process, and the execution result obtained at the aforementioned 
execution process, and the creation information corresponding to the aforementioned execution 
task stored at the aforementioned storing process and the response sentence which were 
generated at the aforementioned generation process. 



[Translation done.] 
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* NOTICES * 

Japan Pat nt Office is not responsible for any 
damag s caused by the use of this translation. 

1 This document has been translated by connputer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] this invention relates to the suitable information processor for application 
to voice dialog equipment, and its control method especially about the information processor 
which can be performed and its control method of two or more kinds of processings by changing 
two or more tasks. 
[0002] 

[Description of the Prior Art] the voice dialog equipment which can treat the task which is 
plurality by improvement in natural-language-processing technology in recent years and 
improvement in speech recognition / synthetic technology has come to be realized In this kind of 
, voice dialog equipment, processing corresponding to the information which chose the task which 
should be processed based on the information inputted by voice, started, and was inputted by 
the started task is performed. And a synthesized speech is generated and outputted based on 
, * this processing result. 
[0003] 

[Problem(s) to be Solved by the Invention] However, with the above-mentioned conventional 
equipment, since the gestalt and synthesized speech of a response sentence which are an 
output are uniform, the user has not grasped whether a different task was started from the voice 
output. Therefore, a user cannot grasp capacity of each task of voice dialog equipment, but may 
demand the processing over two or more tasks. That is, the user has not grasped capacity of 
voice dialog equipment, but had the problem of requiring processings beyond the capacity of the 
voice dialog equipment concerned, such as processing which needs composite of a task. 
[0004] this invention is made in view of the problem of the above-mentioned conventional 
technology, makes it possible to change the gestalt of the response sentence outputted for 
every task, and aims at offering an information processor with possible making it recognize that 
the task changed to the user, and its control method. 

[0005] Moreover, other purposes of this invention make it possible to change the gestalt of a 
response sentence, and its synthesized speech for every task, and are to offer the information 
processor which makes it recognize that the task changed to the user in voice interactive 
processing, and its control method. 

[0006] Moreover, it suppresses that make the capacity of each task grasp and a user performs 
the demand beyond the capacity of voice dialog equipment by this by making a user recognize 
the change rate of a task. 
[0007] 

[Means for Solving the Problem] The information processor of this invention for attaining the 
above-mentioned purpose is equipped with the following composition. Namely, a storing means to 
be the information processor which has two or more tasks which can be performed, and to store 
different creation information corresponding to each of two or more aforementioned tasks, A 
determination m ans to determine the execution task which should analyze an input statement 
and should be used out of two or more aforementioned tasks. The real way stage which 
generates the command which is adapted for the execution task determined with th 
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aforementioned determination means based on the aforem ntion d input stat ment, executes 
this command by this execution task, and obtains an execution result. It has a generation m ans 
to gen rate a response s ntence based on the creation information corresponding to the 
aforementioned execution task stored in the aforementioned storing means, and the execution 
result obtained with the aforem ntioned execution means, and an output means to output the 
response sentence generated with the aforementioned generation means. 
[0008] Moreover, the aforementioned creation information specifies preferably the style of the 
response sentence generated with the aforementioned generation means, for example, ** which 
is - measure tone" and " which are and "existing **" — as — a user is being able to 
recognize a switch of a task easily by changing a style In this case, even if it carries out the 
voice output of the response sentence and carries out a display output, a user can recognize a 
switch of a task. 

[0009] Moreover, the aforementioned creation information specifies preferably the foreground 
color of the response sentence generated with the aforementioned generation means. Since a 
switch of a task is expressed with change of a foreground color, a user can Judge a switch of a 
task very easily. 

[0010] Moreover, preferably, the aforementioned output means synthesizes voice based on the 
aforementioned response sentence, and performs a voice output. 

[001 1] Moreover, the information processor by other composition of this invention which attains 
the above-mentioned purpose A storing means to be the information processor which has two or 
more tasks which can be performed, and to store different creation information corresponding to 
each of two or more aforementioned tasks, A determination means to determine the execution 
task which should analyze an input statement and should be used out of two or more 
aforementioned tasks, The real way stage which generates the command which is adapted for 
the execution task determined with the aforementioned determination means based on the 
aforementioned input statement, executes this command by this execution task, and obtains an 
execution result, A generation means to generate a response sentence based on the creation 
information corresponding to the aforementioned execution task stored in the aforementioned 
storing means, and the execution result obtained with the aforementioned execution means, It 
has a synthetic means to synthesize voice based on the creation information corresponding to 
the aforementioned execution task stored in the aforementioned storing means, and the 
response sentence generated with the aforementioned generation means. 
[0012] Moreover, it has furthier an input-statement generation means to generate an input 
statement preferably based on the inputted sound signal. It is because the voice dialog 
equipment which can input an input statement with voice and synthesizes voice from the 
response sentence to this can be constituted. 

[D013] Moreover, it has preferably a display means to display the aforementioned response 
sentence, further. A response sentence can be recognized visually and a switch of a task can be 
grasped more easily. 

[0014] Moreover, the aforementioned creation information specifies preferably the foreground 
color by the aforementioned display means of the response sentence generated with the 
aforementioned generation means. It is because a switch can be recognized by the foreground 
color of a response sentence and a switch of a task can be Judged more nearly intuitively. 
[001 5] Moreover, the aforementioned creation information contains each parameter of the 
speech synthesis processing in the aforementioned synthetic means preferably. 
[0016] 

[Function] According to the above-mentioned composition, in the information processor which 
has two or more tasks which can be performed, different creation infonnation corresponding to 
each of two or more tasks is stored. By analyzing an input statement, the task which should be 
used out of two or more tasks is determined as an execution task. And the command which is 
adapted for the execution task based on an input statement is generated. By executing this 
command by the execution task, the execution result (it is equivalent to the response 
corresponding to an input statement) of the command concerned is obtained. And out of the 
creation information stored beforehand, the creation information corr sponding to an execution 
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task is obtained, and a response sentence is generated and outputted based on this or ation 
information and the above-mentioned xecution result, 

[001 7] Moreover, according to other above-mentioned composition, in the infomiation processor 
which has two or more tasks which can be performed, different creation information 
corresponding to each of two or more tasks is stored. By analyzing an input statement, the task 
which should be used out of two or more tasks is detennined as an execution task. And the 
command which is adapted for the execution task based on the above-mentioned input 
statement is generated. It carries out by executing this command by the execution task, and an 
execution result is obtained. Next, the creation information corresponding to an execution task is 
obtained out of the creation information stored beforehand, a response sentence is generated 
and generated based on this creation information and an execution result, and it synthesizes 
voice based on creation information and a response sentence further. 
[0018] 

[Example] Hereafter, with reference to an attached drawing, the example of this invention is . 
explained in detail. 

[0019] Drawing 1 is the block diagram showing the block composition of the voice dialog 
equipment of an example. In this drawing, 101 is the voice-input/output section, while carrying 
out [ voice / which was inputted from the microphone ] A/D conversion and incorporating inside 
the equipment concerned, carries out D/A conversion of the generated response, and outputs it 
from a loudspeaker as voice. 102 is the speech recognition section, performs speech recognition 
to the voice inputted from the voice-input/output section 101, and generates an input 
statement. 103 is the sentence analysis section and performs morphological analysis, syntax 
analysis, and a semantic analysis to the input statement recognized in the speech recognition 
section 102. 

[0020] 104 is the task judging section, distinguishes the task performed based on the analysis 
result of the input statement in the sentence analysis section 1 03, and generates the command 
which was adapted for the task to perform. The task distinction section 104 holds the task 
distinction dictionary 301 for distinguishing a task. In this example, in order to give explanation 
intelligible, two tasks shall be treated and it considers as database reference (for example, 
relational database which can perform reference using SQL) of extension guidance of Task A, 
and the full-text search (for example, thing which searches the document containing the 
character string made into conditions from Plain Text (poor character string)) of sightseeing 
guidance of Task B. Of course, the gestalt of the above-mentioned database cannot be 
overemphasized by that it is an example. 

[0021] Drawing 3 is drawing showing the example of data composition of the task distinction 
dictionary 301. In the task distinction section 104, when the word registered into the task 
distinction dictionary 301 into the analysis result analyzed in the sentence analysis section 103 
appears, a task is changed as a thing treating the task. For example, if the task judging dictionary 
301 is referred to about the input statement of "wanting to know the extension of Manager 
Suzuki of the Administrative Division", the task A in which the word of the "Administrative 
Division", the "manager", and an "extension" exists will be chosen. 

[0022] Consequently, the task judging section 104 will generate a command called select 
(extension) from(extension table) where (name = Suzuki, affiliation = Administrative Division, 
executive = manager) which can interpret Task A, and will pass this to Task A. 
[0023] Similarly, Task B is chosen by reference of the task judging dictionary 301 to the input 
statement "teach the art gallery in Hakone-cho." And the task judging section 104 will generate 
the command ((C classification' art gallery) (C address Hakone-cho) (R name ?)) which can 
interpret Task B, and will send this to Task B. 

[0024] 105 is the agent determination section, determines an agent according to the task 
distinguished in the task distinction section 104, and changes an agent. 106,107 is the task A 
statement part and task B statement part which perform a task different, respectively. In this 
example, an "extension agent" presupposes that a "sightseeing agent" is chosen to Task B 
(sightseeing guidanc ), respectively to Task A (extension guidanc ). 

[0025] 1 08 is an agent attribute attaching part and is an agent attribute attaching part which 
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holds synthesized-speech information, such as s nt nee gen ration information, such as s x and 
a tone, and height of voice, and phonation speed, as an attribute for every agent. Draw ing 4 is 
drawing showing the data storage state in the agent attribute attaching part 1 08. Sentence 
generation information and synth sized-speech information are stored in each of the "extension 
agent" determined as the agent attribute attaching part 1 08 in the agent determination section, 
and a "sightseeing agent" as shown in drawing 4 . 

[0026] 109 is the sentence generation section, acquires an agent's sentence generation 
information determined in the agent determination section 105 from the agent attribute attaching 
part 108. and generates the response sentence based on the execution result of the task A 
statement part 106 or the task B statement part 107 with reference to this. Drawin g 5 is drawing 
showing the example of generation of a response sentence. In drawin g 5 , the example of a dialog 
using the above-mentioned command is shown, and it is. That is, while using the extension 
number (here "1234") obtained as the reference conditions "Suzuki" included in the command, 
the "manager", an "extension", and an execution result of Task A, a response sentence is 
generated based on an extension agent's sentence generation information (a woman, existing **). 
Of course, you may make it answer only by the result like a sightseeing agent In this case, a 
response sentence becomes "Being 1234." In addition, the response sentence by the sightseeing 
agent who outputs the execution result of Task B is the same as that of the above-mentioned 
extension agent. 

[0027] 110 is the speech synthesis section, acquires an agent's synthesized-speech information 
determined in the agent determination section 105 from the agent attribute attaching part 108, 
and generates the synthesized speech of the response sentence generated in the sentence 
generation section 1 09 with reference to this. The synthesized speech generated in the speech 
synthesis section 110 is outputted as voice from the loudspeaker of the voice-input/output 
section 101. 111 is a display and outputs a speech recognition result, the flow of a dialog, the 
execution result of a task, a response sentence, etc. In the above, by the sentence generation 
section 1 09, the agent attribute of a woman and a male is referred to setting up any of language 
a woman talks in a response sentence, and language and a male talk, and are used, and is used 
for a setup of the phoneme data for generating the voice of a woman and a mate in the speech 
synthesis section 110. 

[0028] Next, operation of this equipment is explained with reference to the flow chart of drawing 
2 . Drawing 2 is a flow chart showing the control procedure of the voice dialog equipment of an 
example. 

[0029] First, at Step S201, if waiting and voice input are performed in the voice input from the 
voice-input/output section 101, this input will be sent to the speech recognition section 102. At 
Step S202, the speech recognition section 1 02 performs speech recognition, and an input 
statement is obtained. Moreover, this recognition result (input statement) is displayed on a 
display 111, and it moves to Step S203. At Step S203, the sentence analysis section 103 
performs morphological analysis, syntax analysis, and a semantic analysis to the input section 
which it is as a result of recognition, and moves to Step S204. At Step S204, in the task 
distinction section 1 04, the task performed from the analysis result analyzed in the sentence 
analysis section 103 is distinguished, and the command corresponding to the task to perform is 
generated. 

[0030] At Step S205. an agent is determined and changed in the agent determination section 1 05 
according to the task distinguished in the task distinction section 104. At Step S206, in the task 
statement part (either the task A statement part 106 or the task B statement part 107) 
distinguished in the task distinction section 104, the command generated at Step S204 is 
executed, and it moves to Step S207. 

[0031] At Step 8207, the sentence generation section 109 gen rates a response sentence from 
the ex cution result performed by the task A statement part 106 or the task B statement part 
107. In gen ration of this response sentence, the s nt nee gen ration section 109 acquires an 
agent's sentence generation information determined in the agent determination section 105 from 
the agent attribute attaching part 108, and it generates a respons sent no , referring to this 
sentence generation information. The g n rated response sentence is sent to the speech 
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synthesis section 110 while it is table-shown in a display 111 and is mad into it. 
[0032] At Step S208, the speech synthesis section 1 1 0 generat s the synthesiz d sp ech of the 
response sent nee generated in the sentence generation section 1 09. In generation of this 
synthesized speech, the speech synthesis section 110 acquires an agent's synthesized-sp ech 
information determined in the agent determination section 105 from the attribute attaching part 
108, and refer to this synthesized-speech information for it. D/A conversion of the generated 
synthesized speech is carried out in the voice-input/output section 1 01 , and it is outputted from 
a loudspeaker. Then, processing returns to Step S201 . 

[0033] the agent (person in charge) who stated above and who gave attributes, such as sex, a 
tone, height of voice, and phonation speed, like according to the voice dialog equipment of the 
above-mentioned example — every task — setting up — a task — changing — it becomes 
possible to change an agent That is. it can be made conscious of the task having changed to the 
user by changing a response sentence based on sex or a tone (sentence generation information), 
and changing the voice of a synthesized speech based on the height and phonation speed 
(synthesized-speech information) of voice. 

[0034] Therefore, a user becomes possible [ grasping the processing range by one task ], and it 
becomes possible to Judge whether the capacity of the voice dialog equipment concerned for the 
demand which it is going to give from now on to need two or more tasks used to be exceeded. 
[0035] In addition, although it is explained in the above-mentioned example, using the task to 
treat as two in order to give explanation brief, of course, it can be adapted also for the thing 
treating three or more tasks. 

[0036] Moreover, in the above-mentioned example, as an attribute of the response sentence 
changed for every agent, although sex and the tone were used, it does not restrict to this. You 
' ' may make it express a shift of an agent with using the color and font of the response sentence 
displayed on a display as an attribute of a response sentence. 

[0037] Moreover, in the above-mentioned example, it does not restrict to this using the height of 
voice, and phonation speed as an attribute of the synthesized speech changed for every agent. 
You may make it express a shift of an agent with using for example, other study phoneme data, a 
natural descent component, pause length, etc. 

[0038] Moreover, when a generation method prepares two or more mere sentence generation 
sections and changes the. sentence generation section for every agent, you may make it 
generate a different response sentence, although a different response sentence by giving an 
attribute to the single sentence generation section is generated in the above-mentioned 
example. 

[0039] Moreover, although a different synthesized speech by giving an attribute to the single 
speech synthesis section is generated in the above-mentioned example, you may make it 
generate a different synthesized speech by preparing two or more speech synthesis sections 
'from which a generation method differs, and changing the synthesized-speech section for every 

agent. 

[0040] Moreover, although both the gestalt of a response sentence and the gestalt of a 
synthesized speech are changed with a switch of a task, you may make it change one of 
gestalten in the above-mentioned example. 

[0041] As explained above, according to this example, the change of a response sentence and a 
synthesized speech is realizable by having two or more tasks to treat and setting up recognition 
and the agent who does sentence analysis. Judges a task from the analysis result, and changes 
an attribute for every task for the inputted voice. 

[0042] In addition, even if it applies this invention to the system which consists of two or more 
devices, you may apply it to the equipment which consists of one device. Moreover, this 
invention cannot be overemphasized by that it can apply when attained by supplying a program 
to a system or equipment. 
[0043] 

[Effect of the Invention] As explained above, it becomes possibi to change the gestalt of the 
response sentence outputted for v ry task according to this inv ntion, and it becom s possible 
to make it recognize that the task changed to the us r. 
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[0044] Moreover, according to this invention, it becomes possible to chang the gestalt of a 

response sentence, and its synthesized speech for every task, and it becomes possible to make 

it recognize that the task changed to th user in voice interactive processing. 

[0045] As mentioned above, it can suppress that make the capacity of each task grasp and a 

user performs the demand beyond the capacity of voice dialog equipment by this by making a 

user recognize the change rate of a task. 

[0046] 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible f r any 
damages caused by the us of this translation. 

1 . This document has been translated by computerSo the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



TECHNICAL FIELD 



[Industrial Application] this invention relates to the suitable information processor for application 
to voice dialog equipment, and its control method especially about the information processor 
which can be performed and its control method of two or more kinds of processings by changing 
two or more tasks. 



[Translation done.] 
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♦ NOTICES * 

Japan Patent Office is not responsible f r any 
damages caused by the use of this translation. 

1. This document has been translated by computer.So the translation may not reflect the original 

precisely. 

2. **3Mc shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



PRIOR ART 



[Description of the Prior Art] the voice dialog equipment which can treat the task which is 
plurality by improvement in natural-language-processtng technology in recent years and 
improvement in speech recognition / synthetic technology has come to be realized In this kind of 
voice dialog equipment, processing corresponding to the information which chose the task which 
should be processed based on the information inputted by voice, started, and was inputted by 
the started task is performed. And a synthesized speech is generated and outputted based on 
this processing result. 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damag s caused by the use of this translation. 

1 . This document has been translated by computerSo the translation may not reflect the original 
precisely. 

2. 5Mc** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



EFFECT OF THE INVENTION 

[Effect of the Invention] As explained above, it becomes possible to change the form of the 
response sentence outputted for every task according to this invention, and it becomes possible 
to make it recognize that the task changed to the user. 

[0044] Moreover, according to this invention, it becomes possible to change the form of a 
response sentence, and its synthesized speech for every task, and it becomes possible to make 
it recognize that the task changed to the user in voice interactive processing. 
[0045] As mentioned above, it can suppress that make the capacity of each task grasp and a 
user performs the demand beyond the capacity of voice dialog equipment by this by making a 
user recognize the change rate of a task. 
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user performs the demand beyond the capacity of voice dialog equipment by this by making a 
user recognize the change rate of a task. 



[Translation done.] 



http://www4.ipdl jpo.gojp/cgi-bin/tran.w b_cgi_eije 



2003/02/03 



1/2 V 



* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the us of this translation. 

1 . This document has been translated by computerSo the translation may not reflect the original 

precisely. 

2. *3Mc3|c shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



MEANS 



[Means for Solving the Problem] The information processor of this invention for attaining the 
above-mentioned purpose is equipped with the following composition. Namely, a storing means to 
be the information processor which has two or more tasks which can be performed, and to store 
different creation information corresponding to each of two or more aforementioned tasks, A 
determination means to determine the execution task which should analyze an input statement 
and should.be used out of two or more aforementioned tasks, The real way stage which 
generates the command which is adapted for the execution task determined with the 
aforementioned determination means based on the aforementioned input statement, executes 
this command by this execution task, and obtains an execution result. It has a generation means 
to generate a response sentence based on the creation information corresponding to the 
aforementioned execution task stored in the aforementioned storing means, and the execution 
result obtained with the aforementioned execution means, and an output means to output the 
response sentence generated with the aforementioned generation means. 

[0008] Moreover, the aforementioned creation information specifies preferably the style of the 
response sentence generated with the aforementioned generation means, for example, ** which 
is - measure tone" and " which are and "existing — as — a user is being able to 
recognize a switch of a task easily by changing a style In this case, even if it carries out the 
voice output of the response sentence and carries out a display output, a user can recognize a 
switch of a task. 

[0009] Moreover, the aforementioned creation information specifies preferably the foreground 
color of the response sentence generated with the aforementioned generation means. Since a 
switch of a task is expressed with change of a foreground color, a user can judge a switch of a 
task very easily. 

[0010] Moreover, preferably, the aforementioned output means synthesizes voice based on the 
aforementioned response sentence, and performs a voice output. 

[001 1] Moreover, it is characterized by equipping with the following the information processor by 
other composition of this invention which attains the above-mentioned purpose. A storing m ans 
to be the information processor which has two or more tasks which can be performed, and to 
store different creation information corresponding to each of two or more aforementioned tasks. 
A determination means to determine the execution task which should analyze an input statem nt 
and should be used out of two or more aforementioned tasks. Real way stage which generates 
the command which is adapted for the execution task determined with the aforementioned 
determination means based on the aforementioned input statement, executes this command by 
this execution task, and obtains an execution result. A synthetic means synthesize voice based 
on a generation means generate a response sentence based on the creation information 
corresponding to the aforementioned execution task stored in the aforementioned storing means, 
and the execution result obtained with th aforementioned execution means, and th creation 
information corresponding to the aforementioned execution task stored in the afor mentioned 
storing means and the response sent nee generated with the afor mentioned gen ration means. 
[001 2] Moreover, it has further an input-statem nt generation m ans to generate an input 
statement preferably based on the inputted sound signal. It is because the voic dialog 
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equipment which can input an input statem nt with voice and synthesizes voice from th 
response sentence to this can be constitut d. 

[0013] Mor over, it has preferably a display means to display the aforementioned response 
sentence, further. A response sentence can be r cognized visually and a switch of a task can be 
grasped more easily. 

[0014] Moreover, the aforementioned creation information specifies preferably the foreground 
color by the aforementioned display means of the response sentence generated with the 
aforementioned generation means. It is because a switch can be recognized by the foreground 
color of a response sentence and a switch of a task can be Judged more nearly intuitively. 
[0015] Moreover, the aforementioned creation information contains each parameter of the 
speech synthesis processing in the aforementioned synthetic means preferably. 
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OPERATION 



[Function] According to the above-mentioned composition, in the information processor which 
has two or more tasks which can be performed, different creation information corresponding to 
each of two or more tasks is stored. By analyzing an input statement, the task which should be 
used out of two or more tasks is determined as an execution task. And the command which is 
adapted for the execution task based on an input statement is generated. By executing this 
command by the execution task, the execution result (it is equivalent to the response 
corresponding to an input statement) of the command concerned is obtained. And out of the 
creation information stored beforehand, the creation information corresponding to an execution 
task is obtained, and a response sentence is generated and outputted based on this creation 
information and the above-mentioned execution result. 
. [001 7] Moreover, according to other above-mentioned composition, in the information processor 
which has two or more tasks which can be performed, different creation information 
corresponding to each of two or more tasks is stored. By analyzing an input statement, the task 
^ « which should be used out of two or more tasks is determined as an execution task. And the 
command which is adapted for the execution task based on the above-mentioned input 
statement is generated. It carries out by executing this command by the execution task, and an 
execution result is obtained. Next, the creation information corresponding to an execution task is 
obtained out of the creation information stored beforehand, a response sentence is generated 
and generated based on this creation information and an execution result, and it synthesizes 
voice based on creation information and a response sentence further 
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EXAMPLE 



[Example] Hereafter, with reference to an attached drawing, the example of this invention is 
explained in detail. 

[0019] Drawin g 1 is the block diagram showing the block composition of the voice dialogs 
equipment of an example. In this drawing, 101 is the voice-input/output section, while carrying 
out [ voice / which was inputted from the microphone ] A/D conversion and incorporating inside 
the equipment concerned, carries out D/A conversion of the generated response, and outputs it 
from a loudspeaker as voice. 1 02 is the speech recognition section, performs speech recognition 
to the voice inputted from the voice-input/output section 101, and generates an input 
statement. 1 03 is the sentence analysis section and performs morphological analysis, syntax 
analysis, and a semantic analysis to the input statement recognized in the speech recognition 
section 102. 

[0020] 104 is the task judging section, distinguishes the task performed based on the analysis 
result of the input statement in the sentence analysis section 103, and generates the command 
which was adapted for the task to perform. The task distinction section 104 holds the task 
distinction dictionary 301 for distinguishing a task. In this example, in order to give explanation 
intelligible, two tasks shall be treated and it considers as database reference (for example, 
relational database which can perform reference using SQL) of extension guidance of Task A, 
and the full-text search (for example, thing which searches the document containing the 
character string made into conditions from Plain Text (poor character string)) of sightseeing 
guidance of Task B. Of course, the gestalt of the above-mentioned database cannot be 
overemphasized by that it is an example. 

[0021] Drawing 3 is drawing showing the example of data composition of the task distinction 
dictionary 301. In the task distinction section 104, when the word registered into the task 
distinction dictionary 301 into the analysis result analyzed in the sentence analysis section 103 
appears, a task is changed as a thing treating the task. For example, if the task judging dictionary 
301 is referred to about the input statement of "wanting to know the extension of Manager 
Suzuki of the Administrative Division", the task A in which the word of the "Administrative 
Division", the "manager", and an "extension" exists will be chosen. 

[0022] Consequently, the task Judging section 104 will generate a command called select 
(extension) from(extension table) where (name = Suzuki, afFiiiation = Administrative Division, 
executive = manager) which can interpret Task A, and will pass this to Task A. 
[0023] Similarly, Task B is chosen by reference of the task judging dictionary 301 to the input 
statement "teach the art gallery in Hakone-cho." And the task Judging section 104 will generate 
the command ((C classification art gallery) (C address Hakone-cho) (R nanie ?)) which can 
interpret Task B, and will send this to Task B. 

[0024] 1 05 is the agent determination section, d termines an agent according to the task 
distinguished in the task distinction section 104, and chang s an agent. 106,107 is the task A 
statement part and task B statement part which perform a task different, respectively. In this 
example, an "extension agent" presupposes that a "sights eing agent" is chosen to Task B 
(sightseeing guidance), respectively to Task A ( xt nsion guidance). 

[0025] 1 08 is an agent attribute attaching part and is an ag nt attribut attaching part which 
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holds synth sized-speech information, such as s ntence g n ration information, such as sex and 
a tone, and height of voice, and phonation speed, as an attribute for ev ry agent Drawing 4 is 
drawing showing the data storage state in the agent attribute attaching part 108. Sentence 
generation information and synthesized-spe ch information are stored in each of the "ext nsion 
agent" determined as the ag nt attribute attaching part 1 08 in the agent determination section, 
and a "sightseeing agent" as shown in drawing 4 . 

[0026] 1 09 is the sentence generation section, acquires an agent's sentence generation 
information determined in the agent determination section 105 from the agent attribute attaching 
part 1 08, and generates the response sentence based on the execution result of the task A 
statement part 106 or the task B statement part 107 with reference to this. Drawin g 5 is drawing 
showing the example of generation of a response sentence. In drawin g 5 , the example of a dialog 
using the above-mentioned command is shown, and it is. That is, while using the extension 
number (here "1234") obtained as the reference conditions "Suzuki" included in the command, 
the "manager", an "extension", and an execution result of Task A, a response sentence is 
generated based on an extension agent's sentence generation information (a woman, existing 
Of course, you may make it answer only by the result like a sightseeing agent In this case, a 
response sentence becomes "Being 1234." In addition, the response sentence by the sightseeing 
agent who outputs the execution result of Task B is the same as that of the above-mentioned 
extension agent 

[0027] 1 10 is the speech synthesis section, acquires an agent's synthesized-speech information 
determined in the agent determination section 105 from the agent attribute attaching part 108, 
and generates the synthesized speech of the response sentence generated in the sentence 
generation section 109 with reference to this. The synthesized speech generated in the speech 
synthesis section 110 is outputted as voice from the loudspeaker of the voiceHnput/output 
section 101. Ill is a display and outputs a speech recognition result, the flow of a dialog, the 
execution result of a task, a response sentence, etc. In the above, by the sentence generation 
section 1 09, the agent attribute of a woman and a male is referred to setting up any of language 
a woman talks in a response sentence, and language and a male talk, and are used, and is used 
for a setup of the phoneme data for generating the voice of a woman and a male in the speech 
synthesis section 110. 

[0028] Next, operation of this equipment is explained with reference to the flow chart of drawin g 
2 Drawing 2 is a flow chart showing the control procedure of the voice dialog equipment of an 
example. 

[0029] First, at Step S201 . if waiting and voice input are performed in the voice input from the 
voice-input/output section 101, this input will be sent to the speech recognition section 102. At 
Step S202, the speech recognition section 1 02 performs speech recognition, and an input 
statement is obtained. Moreover, this recognition result (input statement) is displayed on a 
display 111. and it moves to Step S203. At Step S203, the sentence analysis section 103 
performs morphological analysis, syntax analysis, and a semantic analysis to the input section 
which It is as a result of recognition, and moves to Step S204. At Step S204, in the task 
distinction section 104, the task performed from the analysis result analyzed in the sentence 
analysis section 103 is distinguished, and the command corresponding to the task to perform is 
generated. 

[0030] At Step S205, an agent is determined and changed in the agent determination section 1 05 
according to the task distinguished in the task distinction section 104. At Step S206, in the task 
statement part (either the task A statement part 1 06 or the task B statement part 1 07) 
distinguished in the task distinction section 1 04, the command generated at Step S204 is 
executed, and it moves to Step S207. 

[0031] At Step S207. the sentence generation section 109 generates a response sentence from 
the execution result performed by the task A statement part 1 06 or the task B statement part 
107. In generation of this response sentenc , the sentence generation s ction 109 acquires an 
agent's sentence generation information determin d in the agent d termination section 105 from 
the agent attribute attaching part 108, and it gen rates a response s ntence, referring to this 
sentence generation information. The g nerated r sponse sentenc is sent to the speech 
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synthesis section 110 while it is table-shown in a display 1 1 1 and is mad into it. 
[0032] At Step S208, the speech synthesis section 1 1 0 generates the synthesized sp ech of the 
response sentence generated in the sentence generation section 1 09. In g neration of this 
synthesized speech, the speech synthesis s ction 110 acquires an ag nts synthesiz d-sp ech 
information determined in the agent determination section 105 from the attribute attaching part 
. 108, and refer to this synthesized-speech information for it D/A conversion of the generated 
synthesized speech is carried out in the voice-input/output section 1 01 , and it is outputted from 
a loudspeaker. Then, processing returns to Step S201. 

[0033] the agent (person in charge) who stated above and who gave attributes, such as sex, a 
tone, height of voice, and phonation speed, like according to the voice dialog equipment of the 
above^-mentioned example — every task — setting up — a task — changing — it becomes 
possible to change an agent That is, it can be made conscious of the task having changed to the 
user by changing a response sentence based on sex or a tone (sentence generation information), 
and changing the voice of a synthesized speech based on the height and phonation speed 
(synthesized-speech information) of voice. 

[0034] Therefore, a user becomes possible [ grasping the processing range by one task ], and it 
becomes possible to Judge whether the capacity of the voice dialog equipment concerned for the 
demand which it is going to give from now on to need two or more tasks used to be exceeded. 
[0035] In addition, although it is explained in the above-mentioned example, using the task to 
treat as two in order to give explanation brief, of course, it can be adapted also for the thing 
treating three or more tasks. 

[0036] Moreover, in the above-mentioned example, as an attribute of the response sentence 
changed for every agent, although sex and the tone were used, it does not restrict to this. You 
^ " may make it express a shift of an agent with using the color and font of the response sentence 
displayed on a display as an attribute of a response sentence. 

[0037] Moreover, in the above-mentioned example, it does not restrict to this using the height of 
* ' voice, and phonation speed as an attribute of the synthesized speech changed for every agent. 
You may make it express a shift of an agent with using for example, other study phoneme data, a 
natural descent component, pause length, etc. 

[0038] Moreover, when a generation method prepares two or more mere sentence generation 
sections and changes the sentence generation section for every agent, you may make it 
generate a different response sentence, although a different response sentence by giving an 
attribute to the single sentence generation section is generated in the above-mentioned 
example. 

[0039] Moreover, although a different synthesized speech by giving an attribute to the single 
speech synthesis section is generated in the above-mentioned example, you may make it 
generate a different synthesized speech by preparing two or more speech synthesis sections 
from which a generation method differs, and changing the synthesized-speech section for every 
agent. 

[0040] Moreover, although both the gestalt of a response sentence and the gestalt of a 
synthesized speech are changed with a switch of a task, you may make it change one of 
gestalten in the above-mentioned example. 

[0041] As explained above, according to this example, the change of a response sentence and a 
synthesized speech is realizable by having two or more tasks to treat and setting up recognition 
and the agent who does sentence analysis, judges a task from the analysis result, and changes 
an attribute for every task for the inputted voice. 

[0042] In addition, even if it applies this invention to the system which consists of two or more 
devices, you may apply it to the equipment which consists of one device. Moreover, this 
invention cannot be overemphasized by that it can apply when attained by supplying a program 
to a system or quipment. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[ Drawin g 1] It is drawing showing the block composition of the voice dialog equipment of an 
example. 

[ Drawin g 2] It is a flow chart showing the control procedure of the voice dialog equipment of an 
example. 

[Drawing 3] It is drawing showing the example of data composition of the task distinction 
dictionary 301 . 

[Drawing 4] It is drawing showing the data storage state in the agent attribute attaching part 
108, 

[ Drawin g 5] It is drawing showing the example of generation of a response sentence. 
[Description of Notations] 

1 01 Voice-input/output Section 

102 Speech Recognition Section 

103 Sentence Analysis Section 

1 04 Task Distinction Section 

1 05 Agent Determination Section 

1 06 Task A Statement Part 

1 07 Task B Statement Part 

108 Agent Attribute Attaching Part 

1 09 Sentence Generation Section 

110 Speech Synthesis Section 

1 1 1 Display 
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So KtiX^m\-t^^h\zi.^ . m.^(0^:^^(D'p7!)^ 

hmm-t-<^^7.^tmn9:^i' tL-xm-^^fx-^, ^ 
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[0 0 18] 

[001 9 J SI 1 \-i:mm.m(o'^pmssmm.(Dy'o -y 

1 0 2 tt#^^|g^^-efc "3 . #^Aai;^g|5 1 0 1 J; ij A 
;^$ixfci?^fc*fLT#^^ai6Srm\ A;^:S:Sr^5fe-f 
So 1 0 3 115:^95 t?fc 9 . 10 2 tC*5V> 

[0 0 2 01 1 0 4H:^^^'JflJ^?a5-Cfct), Xfm^l 

0 3 {c*j(tSA;^5:<75ftWM*t::S-:3v>TlltTl-5^^ 

-rSo ^5';^i?fiJSija5i 0 4(i. ^;^^'2rWSiJ-t-SfcJi)<^ 
WJ^S3 0 1 S:«^#LTV^5„ *IIJg«»lT-tt. 

ta?^^fc>j!i^'9-^-r<1--5fc*2o(Di?;^i?^®5 h(Dt 

T^dr;^ h (-ifc:st^?ij) ^^pj^feft^t Lfc:S:^?'J^Sr-&^f5: 

[00 2 1] 0 3ttt?;^^*IJSlJ5^S=3 0 IOTt'-^'^^ 

^«l$r*-rEIT-fc5„ ^;^i!'fiJSija51 0 4T-(i. XWSxU 

1 0 3T-^4(f$nfc^^fflS^4'{c^;^i>'fiJgiJS5»3 0 i 

#^*lF15ft<7?f^iSISr*P'?fcV\ J ^:v^9 A;'3Jttv:ov^r^ 
;^^'^J^efm3 0 1 5r#fiS.-rSi:, mmn>l . rg|5 

[00 2 2] wCD/g;!:, ^ tlJ^SfC 1 0 4 (i, 
AiamTSi'^Wii. select (l^^) from (.fHf^7—:/jU) 
where (iS»=|&*, FfJS=il^«fi5. SIK=S|5fi) irV^ 

[ 0 0 2 3 J mmic^ m^michi>m'imi:m.^ 

Xo J i:v^9A:^:S:»c*fU-C«:, ^;^^*iJ^#3 0i 

^^1 0 4(i^^i5'B2i5Sf3iR-5itg/£. ( (c^m mm 



[0 0 2 4] 1 0 5(i:E— hg^:^gB-Cfc'9 , ^-7, 

i!' WSiJgp 1 0 4 T'^iJSU $ ixfc ^ ;^ ^' izfS- C r i y 
h^^^L, i^aiV ho^^^)#;t§:^TPo 106, 

nn. ^^^^ Bmnnx-h^o ^^mxa. ^^^^a (f^ 

[0 0 2 5] \O8\t:^-i?z^'yhm,'&^nnX'h'0. 

>- hStti*^^ 10 8 (c*5(t5v^-^*&iW^^«5r«t-|ll 
TfeSo lll4{c^$^^TV^S<t5^;^ 31— hjgtt 

[0 0 2 6] 1 0 9 ttSl^ffigPTfe ►) . 31— v;=3i:/ hSt 
^^fiJl 0 5-e9t*$nfc3i-v?3iV h<05:^fig1^^8S:ai 

T^^i^ All=ffa51 0 e^Jl^;^^ BH^ffE 1 0 7(D|| 

r^^j , r*B:5j , rt^^j i:, i5';^i?A(Ojl 
4 J ) Srfflv^st irfctc. rtlSai— :;?^vh(D:S:^fig1t 

^•rsi 5(cLT'bAi'^ wCD:^-g-, jS^Xii. ri2 

[0 0 2 7] 110 i-i'&P'^^&X'h ^ . 3i-v;fi V h 

5r3i-v?=:/ hMtttftl^^l 0 8 J; tjJI^L. rix5r# 
RS.LT. rt^fig^l 0 9X'±^^rLtz.lZ-^X(D^^^f^ 
^^^-r^o ^^-a-^asi 1 0T':ifi£$ixfc^J5£*^(i 

?)o 1 1 1 (l^^gBTfc 9 , *j-|!§ro?jft 

*il^T, ^14. B<4<^3i-i?3.>^h;gttH:, It^figSei 

[0 0 2 8] »i:lc:E12<07n— h$r#MLT, 
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[0 0 2 91 >^xs/ys 2 0 1 fli, "^PT^mtJ 

S 2 0 2 T-(i. ^^MiggB 1 0 2 (c J; fj ^^^ISSr^f 

1 1 1 (C^;^LT^-r s/^S 2 0 3 (d^^o ;^7'-;/7'S 

2 0 3 Ttl. 3t8l^ffa5 1 0 3 MISIS*T-*>.5 A;^^ 

V:fS20 A\ZM^^ ^T^S'T'S 2 0 4-t?«:, 

giJSB 10 4 {c*5^^T. -xn^% 1 0 3 T•^W^^^fc^ 

[0 0 3 0] ;^7"s'7'S 2 0 5-T?tt. ^— i^a^VhSt^ 
asi 0 5icio^^T. ^;^^!|£ij»j?FBi 0 4 r-WJ^ixfciJ' 

5/ IT'S 2 0 6.-e(S, ^^:!^WSlJSfBl 0 4 -effilj $ tlfc 
;^i^^^f^^P (;5';^^A||^Tlfl51 0 6*)^)^^tt^'>^^'Bj| 

=fT^ 1 0 7(DV>-f iXTl^) fCfeV^T. ;^X2/7°S 2 0 4t? 
^fej6S$ttfc = ?>- K$rll^TL, 2 0 Ttdigt 

5, ■ 

[00 3 1] ;^7"5'ys 2 0 7T-(S, Jt^JSKSBl 0 9 

i?;^i?A||=fTa5i 0 6fcs^M4^;^i>■Bll^T^fBl 0 
^3:<??^^fc:fc7toT, -X^^U 10 9 (431— r;?!^' h 

^S^fBl 0 5 r-*^$ix^c:3i— v^oi^ h<?:)5:^fig|ff#§r 
^— i^^i^i^ hM't4{S:^^a51 0 8 J: 19 JI#L. rco^tit^ig 

1 1 Otcjiltixs, 

[0 0 3 21 ^X5'^S2 0 8T'(4, ^^-g-figSU 1 1 0 

i:^j«gi5i 0 9-T?^j5K$ix7t£c;^:S;ro-^^^?^^^ 

1 Ottai-y^vh^^gBl 0 5T-gt^$tl.ycJ^-v'3i 

> h n^&^^'^m.^Wk'^'^nu 1 0 8 J; 19 a# r .. 

Xmti^X 0 l-CD/A^JJi$ixT>^f-*J;i9m;^$ 
ix^o ^<0^, *!]:Stt;^X5'7°S 2 0 1 -^M-Sc 
[00 3 31 J; 5 ±IS^JS^JW*^*ffg 

[0 0 3 41 ^*oT3.— •ffiio<0^::^:J'JCj;5MaiS 
B5rfflgi-S^ij)>'Wtet^jJ'9, rtL*^e>4-;tJ:9 t•r 
5 i!**5«S:<^ ^ ^ Sr£>^ t -r 5 J: 5 ^ ^^^*f IS 



[00 3 51 ±s&mmm-r^ti. nf^^iesmz-r^ 

-5Ay. 3oti±<D:?x^^®9'b»{C'biigjCST-#5fc(7D 
[0 0 3 61 * fc. ±IEIIiS«sjT-tt, :^ h r i: 

[0 0 3 71 Sfc. ±f2lli6^i|-CI4. ^-v?a.vhrt 

[0 0 3 81 ifc, JifBUJS^ii-^'tt, *-(o:S:^^a5(c 

^— h Z'tlzX^^n^W 9 #x.5 r i: {c J: ?) , 
[0 0 3 91 -hf5*J6^«Jri4. <^i^^#J5gSB 

[0 0 4 01 ifc, ±IHIIJifi»jT-f4, ^;^^cD^>)i^x. 

[004 11 &.±mm Lfc i 9 (c, ^HiS^Jtc: J;tvl4, 

i3 J; Ot-e-fi)cl^^(0§3 ^) # ^ ^ ^^T' # .5 , 
[0 0 4 21 tS\. *3§W«:. ^IS<OflSI|gd»C,«fiK$ti,5 

7 A ^^l&t- -5 C i: Id J; o T*itE ^ ^ ii-g- t Sffl T- 
[0 0 4 31 

[0 0 4 41 ^mmziitii£. it>^X(omWim: 

t ?r -fr 5 r i 3!i5 oifg t ?t o 
[0 0 4 51 iJiiroiptC. flJffl#lC^J^^ro^i5#i3 
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10 0 4 6] 

[11141 3^-V?a:>'hJStti%«f.gi51 0.8lC*J{t57'-iJ' 



[E51 f£:¥:S:ro^B£«s|^S:«-fia-e*>5. 
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